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(54) Recording/reproduction apparatus and method as well as recording medium 



(57) The invention provides a recording/reproduc- 
tion apparatus and method as well as a recording me- 
dium wherein, when nondestructive editing is executed 
for an AV signal, the AV signal can be reproduced seam- 
lessly without suffering from any interruption. Informa- 



tion representative of states (an A type, a C type, a D 
type, or an E type) of an IN point and an OUT point on 
a Clip, designated by a Playitem, of a Playlist in which 
at least more than one Playitems are arranged in the 
order of reproduction is described in a block PlayitemQ. 
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Description 

[0001] This invention relates to a recording/reproduc- 
tion apparatus and method as well as a recording me- 
dium, and more particularly to a recording/reproduction 
apparatus and method as well as a recording medium 
suitable for use to seamlessly reproduce discontinuous 
AV data read out by random accessing. 
[0002] In recent years, a DVD-RAM (Digital Versatile 
Disk-Random Access Memory) and so forth have been 
developed as a medium onto and from which data can 
be recorded and reproduced. Such large capacity media 
as a DVD-RAM are expected very much as media onto 
which a digital AV (Audio Visual) signal such as a video 
signal is to be recorded. 

[0003] As a supply source of a digital AV signal to be 
recorded onto a DVD-RAM or the like, an AV signal re- 
corded on a VHS cassette tape, an 8-mm tape and so 
forth which are existing recording media, an AV signal 
as a broadcasting signal of digital satellite broadcasting, 
digital ground wave broadcasting, digital cable televi- 
sion broadcasting or the like, or a like AV signal is avail- 
able. 

[0004] A digital video signal supplied from any source 
described above is normally in a form compressed and 
coded in accordance with the MPEG (Moving Picture 
Experts Group) 2 system. Accordingly, when a digital 
video signal supplied from any source is recorded onto 
a DVD-RAM or the like, an AV signal compressed and 
coded in accordance with the MPEG2 system must be 
decoded once and then encoded in accordance with the 
MPEG2 system and recorded onto the optical disk. 
However, where an AV signal in a compressed and cod- 
ed state is decoded and encoded again in this manner, 
the quality of the AV signal is deteriorated significantly. 
[0005] Therefore, in order to minimize the deteriora- 
tion of the quality of an AV signal, it is investigated to 
record an AV signal in a compressed and coded state 
supplied from any source in the form of a bit stream as 
supplied onto a DVD-RAM or the like without encoding 
and decoding the AV signal. In other words, it is inves- 
tigated to use a DVD- RAM or the like as a data streamer. 
[0006] A disk medium such as a DVD-RAM allows 
high speed random accessing thereto. Thus, it is con- 
venient if this fact can be utilized to reproduce a bit 
stream recorded on a DVD-RAM or the like in an order 
different from the order in which it is recorded. To des- 
ignate a reproduction order is a kind of editing, and des- 
ignation of a reproduction order is performed without 
any change in arrangement of the bit stream recorded 
on the disk. In the following, such editing as just de- 
scribed is described as nondestructive editing. 
[0007] However, since the arrangement of a bit 
stream on a disk medium is not necessarily in an opti- 
mized state for nondestructive editing, there is a subject 
that, when nondestructive editing is actually executed, 
the AV signal is interrupted at a changeover point of the 
bit stream and so forth. 



[0008] Various respective aspects and features of the 
invention are defined in the appended claims. 
[0009] Embodiments of the present invention can pro- 
vide a recording/reproduction apparatus and method as 
5 well as a recording medium wherein, when nondestruc- 
tive editing is executed for an AV signal, the AV signal 
can be reproduced without suffering from any interrup- 
tion. 

[0010] According to an aspect of the present inven- 
io tion, there is provided a recording/reproduction appara- 
tus for recording or reproducing AV data onto or from a 
recording medium, comprising AV data file recording 
means for recording an AV data file obtained by convert- 
ing the AV data into a file onto the recording medium, 
production means for producing reproduction range in- 
formation representative of a range of reproduction of 
the AV data file, classification means for classifying a 
state of at least one end of the range of reproduction, 
addition means for adding information representative of 
a result of the classification of the classification means 
to the reproduction range information, preparation 
means for arranging at least more than one piece of the 
reproduction range information in order for reproduction 
to prepare a reproduction list, and reproduction list re- 
cording means for recording the reproduction list onto 
the recording medium. 

[001 1 ] The classification means may classify the state 
of at least one end of the reproduction range into one of 
four types. 

[0012] The recording/reproduction apparatus may 
further comprise formation means for forming a bridge 
sequence in response to a result of the classification of 
the classification means. 

[001 3] According to another aspect of the present in- 
vention, there is provided a recording/reproduction 
method for a recording/reproduction apparatus for re- 
cording or reproducing AV data onto or from a recording 
medium, comprising an AV data file recording step of 
recording an AV data file obtained by converting the AV 
data into a file onto the recording medium, a production 
step of producing reproduction range information repre- 
sentative of a range of reproduction of the AV data file, 
a classification step of classifying a state of at least one 
end of the range of reproduction, an addition step of add- 
ing information representative of a result of the classifi- 
cation by the processing in the classification step to the 
reproduction range information, a preparation step of ar- 
ranging at least more than one piece of the reproduction 
range information in order for reproduction to prepare a 
reproduction list, and a reproduction list recording step 
of recording the reproduction list onto the recording me- 
dium. 

[0014] According to a further aspect of the present in- 
vention, there is provided a recording medium on which 
a computer-readable program for recording or repro- 
ducing AV data onto or from an information recording 
medium is recorded, the program comprising an AV data 
file recording step of recording an AV data file obtained 
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by converting the AV data into a file onto the information 
recording medium, a production step of producing re- 
production range information representative of a range 
of reproduction of the AV data file, a classification step 
of classifying a state of at least one end of the range of 5 
reproduction, an addition step of adding information rep- 
resentative of a result of the classification by the 
processing in the classification step to the reproduction 
range information, a preparation step of arranging at 
least more than one piece of the reproduction range in- 10 
formation in order for reproduction to prepare a repro- 
duction list, and a reproduction list recording step of re- 
cording the reproduction list onto the information record- 
ing medium. 

[0015] In the recording/reproduction apparatus, the 15 
recording/reproduction method and the program of the 
recording medium, an AV data file obtained by convert- 
ing AV data into a file is recorded, and reproduction 
range information representative of a range of reproduc- 
tion of the AV data file is produced. Further, the state of 20 
at least one end of the range of reproduction is classi- 
fied, and information representative of a result of the 
classification is added to the reproduction range infor- 
mation. Further, a reproduction list in which at least more 
than one piece of reproduction range information are ar- 25 
ranged in the order in which they are to be reproduced 
is prepared, and the reproduction list is recorded onto 
the recording medium. Consequently, the AV data can 
be recorded in such a manner that, when nondestructive 
editing is executed, the AV signal can be reproduced 30 
without interruption. 

[0016] According to a still further aspect of the present 
invention, there is provided a recording/reproduction ap- 
paratus for recording or reproducing AV data onto or 
from a recording medium, comprising readout means for 35 
reading out a reproduction list recorded on the recording 
medium, extraction means for extracting information 
representative of a state of at least one end of a range 
of reproduction from among at least more than one 
piece of reproduction range information which forms the 40 
reproduction list, and reproduction means for reproduc- 
ing the AV data recorded on the recording medium 
based on the information representative of the state of 
the at least one end of the range of reproduction extract- 
ed by the extraction means. 45 
[001 7] According to a yet further aspect of the present 
invention, there is provided a recording/reproduction 
method for a recording/reproduction apparatus for re- 
cording or reproducing AV data onto or from a recording 
medium, comprising a readout step of reading out a re- 50 
production list recorded on the recording medium, an 
extraction step of extracting information representative 
of a state of at least one end of a range of reproduction 
from among at least more than one piece of reproduc- 
tion range information which forms the reproduction list, 55 
and a reproduction step of reproducing the AV data re- 
corded on the recording medium based on the informa- 
tion representative of the state of the at least one end 



of the range of reproduction extracted by the processing 
in the extraction step. 

[001 8] According to a yet further aspect of the present 
invention, there is provided a recording medium on 
which a computer-readable program for recording or re- 
producing AV data onto or from an information recording 
medium is recorded, the program comprising a readout 
step of reading out a reproduction list recorded on the 
information recording medium, an extraction step of ex- 
tracting information representative of a state of at least 
one end of a range of reproduction from among at least 
more than one piece of reproduction range information 
which forms the reproduction list, and a reproduction 
step of reproducing the AV data recorded on the infor- 
mation recording medium based on the information rep- 
resentative of the state of the at least one end of the 
range of reproduction extracted by the processing in the 
extraction step. 

[0019] In the recording/reproduction apparatus, the 
recording/reproduction method and the program of the 
recording medium, a reproduction list recorded is read 
out, and from within at least morethanone piece of re- 
production range information which forms the reproduc- 
tion list, the information representative of the state of at 
least one end of the extracted reproduction range is ex- 
tracted, and AV data recorded on the recording medium 
are reproduced based on the extracted information rep- 
resentative of the state of at least one end of the repro- 
duction range. Consequently, when nondestructive ed- 
iting is executed, the AV signal can be reproduced with- 
out interruption. 

[0020] The invention will now be described by way of 
example with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
ences, and in which: 

FIG. 1 is a block diagram showing a construction of 
an optical disc apparatus to which the present in- 
vention is applied; 

FIG. 2 is a diagrammatic view illustrating a relation- 
ship of a Clip and a Playlist; 
FIG. 3 is a flow diagram showing a construction of 
the Clip; 

FIG. 4 is a diagram showing a structure for manag- 
ing an AV stream; 

FIG. 5 is a view showing a directory structure of data 
stored on an optical disc; 

FIG. 6 is a table illustrating the syntax of a file info, 
dvr; 

FIG. 7 is a table illustrating the syntax of a file 
%%%%.clpi; 

FIG. 8 is table illustrating syntax of a file Playlist###. 
plst; 

FIG. 9 is a table illustrating the syntax of a block 
Playlist(); 

FIG. 10 is a table illustrating the syntax of a block 
Playitem(); 

FIG. 11 is a diagrammatic view illustrating division 
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of a Playitem at a discontinuity point of a PCR; 
FIG. 12 is a diagrammatic view illustrating that the 
Playlist is constructed from a main path and an AUX 
audio path; 

FIG. 13 is a diagrammatic view illustrating division 5 
of the Playlist; 

FIGS. 14A and 14B are diagrammatic views illus- 
trating different manners of combination of Playl- 
ists; 

FIG. 1 5 is a diagrammatic view illustrating an exam- 
ple of seamless connection using a bridge se- 
quence; 

FIG. 1 6 is a block diagram illustrating movement of 
a Playlist; 

FIG. 1 7 is a diagrammatic view illustrating an exam- 
ple of Clip conversion; 

FIG. 1 8 is a diagrammatic view illustrating an exam- 
ple of minimization of a Clip; 
FIG. 19 is a table illustrating types of a connection 
point between Playitems; 

FIGS. 20A to 20D are diagrammatic views showing 
an example of different types of connection points 
between Playitems; 

FIGS. 21 A and 21 B are diagrammatic views illus- 
trating different relationships of a bridge sequence 
and a clean break; 

FIGS. 22A and 22B are diagrammatic views illus- 
trating different relationships between a clean break 
and a bridge sequence; 

FIGS. 23-to26B are diagrammatic views illustrating 
different examples of the state of a bridge se- 
quence; 

. FIG. 27 is a flowchart illustrating a Playlist produc- 
tion process; 

FIG. 28 is a flowchart illustrating a Playlist repro- 
duction process; and 

FIG. 29 is a flowchart illustrating a process when a 
connection point is determined as that of a D type. 

[0021] FIG. 1 shows an example of a construction of 
an optical disk apparatus to which the present invention 
is applied. Referring to FIG. 1 , the present optical disk 
apparatus compresses, codes and multiplexes an AV 
signal inputted thereto, for example, in accordance with 
the MPEG system or the like, records an AV stream file 
obtained by converting the AV signal into a file onto an 
optical disk 1 such as a DVD-RAM, and reproduces an 
AV signal from the optical disk 1 on which AV stream 
files are recorded. In the present optical disk apparatus, 
a single optical head 2 is provided for the one rewritable 
optical disk 1 , and the optical head 2 is used for both of 
reading out and writing of data. 

[0022] A bit stream read out from the optical disk 1 by 
the optical head 2 is demodulated by an RF and demod- 
ulation/modulation circuit 3, and error correction is per- 
formed for the demodulated bit stream by an ECC circuit 
4. Then, the bit stream from the ECC circuit 4 is sent 
through a switch 5 to a readout channel buffer 6 for ab- 
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sorbing a difference between the readout rate and a de- 
coding processing rate. An output of the readout chan- 
nel buffer 6 is supplied to a decoder 7. The readout 
channel buffer 6 is formed such that writing into and 
reading out from the readout channel buffer 6 can be 
controlled by a system controller 13. 
[0023] The bit stream outputted from the readout 
channel buffer 6 is decoded by the decoder 7, and a 
video signal and an audio signal are outputted from the 
decoder 7. The video signal outputted from the decoder 
7 is inputted to a synthesis circuit 8, by which it is syn- 
thesized with a video signal outputted from an OSD (On 
Screen Display) control circuit 9. The synthesized signal 
from the synthesis circuit 8 is outputted from an output 
terminal P1 to a display unit not shown so that it is dis- 
played on the display unit. The audio signal outputted 
from the decoder 7 is sent from another output terminal 
P2 to and reproduced by a speaker not shown. 
[0024] On the other hand, a video signal inputted from 
an input terminal P3 and an audio signal inputted from 
another input terminal P4 are encoded by an encoder 
1 0 and then sent to a write channel buffer 1 1 for absorb- 
ing the encoding processing rate and a writing rate. Also 
the write channel buffer 1 1 is constructed such that read- 
ing and writing control from and into the write channel 
buffer 1 1 can be performed by the system controller 1 3 . 
[0025] Data stored in the write channel buffer 1 1 are 
read out from the write channel buffer 11 and inputted 
through the switch 5 to the ECC circuit 4, by which error 
correction codes are added to the data. Then, the data 
from the ECC circuit 4 are modulated by the RF and de- 
modulation/modulation circuit 3. A signal (RF signal) 
outputted from the RF and demodulation/modulation cir- 
cuit 3 is written onto the optical disk 1 by the optical head 
2. 

[0026] An address detection circuit 12 detects ad- 
dress information of a track of the optical disk 1 to be 
recorded or read out. The system controller 13 controls 
operation of the components of the optical disk appara- 
tus, and includes a CPU 21 for performing various con- 
trols, a ROM 22 in which processing programs to be ex- 
ecuted by the CPU 21 and so forth are stored, a RAM 
23 for temporarily storing data and so forth produced in 
a processing procedure, and a RAM 24 for storing var- 
ious information files to be recorded onto or reproduced 
from the optical disk 1. The CPU 21 finely adjusts the 
position of the optical head 2 based on a result of de- 
tection of the address detection circuit 12. The CPU 21 
further performs switching control of the switch 5. An in- 
putting section 14 including various switches, buttons 
and so forth is operated by a user in order to input var- 
ious instructions. 

[0027] Subsequently, a scheme of nondestructive ed- 
iting wherein some ranges or the entire range of an AV 
stream file recorded on the optical disk 1 is designated 
and the thus designated ranges are reproduced succes- 
sively is described. 

[0028] FIG. 2 illustrates a file Playlist in which an order 
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for reproduction in nondestructive editing is described. 
The Playlist is a unit designated by a user and corre- 
sponding to one or more streams to be reproduced suc- 
cessively. A Playlist of the simplest construction is ob- 
tained if it is designated that the range of a certain one 
stream from its recording start position to its recording 
end position should be reproduced. 
[0029] The Playlist is composed of information which 
designates an AV stream and information representa- 
tive of a reproduction start point (IN point) and a repro- 
duction end point (OUT point) in the AV stream. A set of 
information which designates an AV stream and infor- 
mation representative of a start point and an end point 
of the AV stream is collectively referred to as PI ay item. 
In other words, a Playlist is composed of one or more 
Play items. 

[0030] If a Playitem is reproduced, then the range 
from the IN point and the OUT point of a specified AV 
stream is reproduced. 

[0031 ] An AV stream is a bit stream multiplexed in the 
form of a transport stream or the like prescribed by the 
MPEG2, and if information relating to the AV stream is 
stored as a file (hereinafter referred to as AV stream in- 
formation file) separate from an AV stream obtained by 
converting the AV stream into a file, then reproduction 
and editing are facilitated further. An AV stream file and 
an AV stream information file are regarded as an object 
as a unit of information and is called Clip. In particular, 
as seen in FIG. 3, the Clip is an object composed of an 
AV stream file and an AV stream information file (indi- 
cated as Stream attributes in FIG. 3) which correspond 
in a one-by-one corresponding relationship to each oth- 
er. 

[0032] As seen in FIG. 4, a Playlist, a Playitem and a 
Clip are provided hierarchically to allow nondestructive 
editing. 

[0033] Here, attention is paid to connection points be- 
tween Playitems. While two Playitems individually refer 
to different Clips, a transport stream (AV stream) read 
in from the optical disk 1 sometimes becomes discon- 
tinuous at connection points between the Playitems. 
The factor of such discontinuity is provided by disconti- 
nuity of the syntax in the transport stream or by discon- 
tinuity of supply from two files. 

[0034] If discontinuity is present at a connection point 
of a Playitem, then such deterioration of the reproduc- 
tion quality that an image reproduced becomes a still 
picture or an image or sound is interrupted occurs. How- 
ever, if the factor of the discontinuity at the connection 
point of the Playitem is known in advance before the 
connection point of the Playitem is reproduced, then the 
deterioration of the reproduction quality at the connec- 
tion point can be suppressed. 

[0035] If discontinuity in supply from two files is 
present at a connection point at a Playitem, then the low- 
est readout rate of the file should be assured. In other 
words, a countermeasure should be taken to prevent the 
readout channel buffer 6, which stores a read out AV 
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stream before it is decoded, from underflowing. 
[0036] Here, the reproduction system of the optical 
disk apparatus of FIG. 1 is examined in a simplified form 
which merely includes the optical disk 1 , readout chan- 

5 nel buffer 6 and decoder 7. Since data cannot be read 
from the optical disk 1 during random accessing, in order 
to prevent the readout channel buffer 6 from underflow- 
ing, it is necessary to store a certain amount of data in 
the readout channel buffer 6 immediately before track 

10 jumping within which reading of data is impossible is 
performed. Such control can be realized by handling a 
sector, which is a storage area on the optical disk 1 , as 
blocks. 

[0037] For example, a set of adjacent sectors which 
15 can be read out continuously without track jumping is 
considered and is called fragment. The rule that a frag- 
ment always includes more than a fixed rate of data is 
provided. The rule that, for example, the rate of data 
which occupy in each fragment is always higher than 
one half the size of one fragment. In other words, where 
an area occupied by data in a fragment is called seg- 
ment, the condition that the magnitude of a segment is 
greater than one half a fragment is set. Such a fixed rate 
is determined taking the time required for jumping from 
a fragment which is present at an arbitrary position on 
the optical disk 1 to another fragment which is present 
at another arbitrary position, the size of the fragment, 
the burst readout rate and so forth into consideration. 
[0038] If the construction described above is em- 
ployed, then where jumping upon random accessing is 
performed in a unit of a fragment, since some amount 
of data is present in each fragment, jumping between 
fragments can be performed in a state wherein a suffi- 
cient amount of data is present in the readout channel 
buffer 6. In other words, it is possible to supply data to 
the decoder 7 while assuring the lowest rate. 
[0039] Now, a case wherein discontinuity is present 
in the syntax of a transport stream is considered. Usu- 
ally, even if two bit streams MPEG encoded and multi- 
plexed separately from each other are individually cut 
in a unit of a transport packet and cut faces of the dif- 
ferent bit streams are joined together, a stream of the 
correct syntax as prescribed in the MPEG systems is 
not obtained. Further, since different transport streams 
are different also in a PCR (Program Clock Reference) 
which is a reference to the time base included in a trans- 
port stream, when decoding is to be performed across 
the connection points of them, such processing as to re- 
set the time base based on a new PCR is required. 
[0040] Accordingly, even if information of whether or 
not discontinuity of the syntax is present at a connection 
point of a Playitem and information of the type of the 
discontinuity are known when decoding is to be decod- 
ed, they cannot be used in time. Therefore, the optical 
disk apparatus of the present invention is constructed 
such that it can supply information of whether or not dis- 
continuity of the syntax is present at a connection point 
of a Playitem and information of the type of the discon- 
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tinuity to the decoder 7 in advance. 
[0041 J Here, arrangement of files written on the opti- 
cal disk 1 (which may be hereinafter referred to simply 
as disk) is described. The following four kinds of files 
are recorded on the disk as seen in FIG. 5. 

info.dvr 

playlist###.plst 

%%%%.clpi 

%%%%.mpg 

[0042] A directory /DVR is provided on the disk, and 
the directory /DVR and so forth make a range managed 
by the optical disk apparatus. However, the directory 
/DVR may be a root directory of the disk or may be 
present under another arbitrary directory. 
[0043] The file info.dvr is disposed in the directory 
/DVR. Further, a directory /PLAYLIST, another directory 
/CLIPINF and a further directory /AVSTREAM are dis- 
posed below the directory /DVR. 
[0044] The files playlist###.plst are disposed below 
the directory /PLAYLIST. The files %%%%.clpi are dis- 
posed below the directory /CLIPINF. The files %%%%. 
mpg are disposed below the directory /AVSTREAM. 
[0045] FIG. 6 illustrates a structure of the file info.dvr 
disposed only one under the directory /DVR. The file in- 
fo.dvr has blocks formed individually for different kinds 
of information classified for individual functions. Infor- 
mation regarding the volume is placed in a block DVR- 
VolumeQ. information regarding the arrangement of 
Playlists is placed in another block PlayListBlock(). In- 
formation regarding the arrangement of Clips is placed 
in a further block ClipList(). Information for linking a plu- 
rality of volumes with each other is placed in a still further 
block MultiVolumeQ. 

[0046] Addresses at which the tops of the blocks are 
recorded are described at a top portion of the file info, 
dvr. In particular, DVRVolume_start_address repre- 
sents the position at which the block DVRVolume() 
starts in an intra-file relative byte number. 
PlayListBlock_start_address represents the position at 
which the block PlayListBlock() starts in an intra-file rel- 
ative byte number. ClipList_start_address represents 
the position at which the block ClipListQ starts in an in- 
tra-file relative byte number. 

MultiVolume_start_address represents the position at 
which the block MultiVolume() starts in an intra-file rel- 
ative byte number. 

[0047] The files %%%%.clpi below the directory /CL- 
IPINF are produced in a one-by-one corresponding re- 
lationship to AV stream files %%%%.mpg below the di- 
rectory /AVSTREAM. FIG. 7 illustrates a structure of a 
file %%%%.clpi. Also the file %%%%.clpi has blocks 
formed for individual kinds of information classified for 
individual functions. 

[0048] Information regarding a Clip is placed in the 
block Cliplnfo(). Information regarding a discontinuity 
point (where attention is paid to a continuous range de- 
limitated by discontinuity points, it is called also contin- 
uous section) is placed in the block SequencelnfoQ. In- 



formation regarding CPI (Characteristic Point Informa- 
tion) representative of a characteristic point which can 
be randomly accessed in an AV stream is placed in the 
block CPI(). Information of an index point for a head 

5 search applied to a Clip or start and end points of a com- 
mercial is placed in the block MarkList(). Addresses rep- 
resentative of the tops of the individual blocks are de- 
scribed in a top portion of the file %%%%.clpi. 
[0049] The files playlist###.plst below the directory / 

10 PLAYLIST are produced by one for each playlist. FIG. 
8 shows a structure of a file playlist###.plst. The file 
playlist###.plst has a block PlaylistQ in which informa- 
tion regarding the playlist is placed, and an address 
(Playlist_start_address) representative of the top of the 

15 block PlaylistQ is described at a top portion of the file 
playlist###.plst. Consequently, it is possible to insert a 
padding_byte before or after the block Playlist(). 
[0050] FIG. 9 shows a structure of the block PlayList 
(). The version_number represents a version number of 

20 information described in the following portion. The 
aux_audio__valid_flag represents whether or not the 
PlayList has audio for post-recording. When the 
aux_audio_valid_flag represents "No", the PlayitemQ 
for the aux_audio is ignored and is not reproduced. 

25 [0051 ] The playlist_type represents a type of the play- 
list. The playlist_name_length represents a data length 
of the name of the playlist. A character string represent- 
ative of the name is described by a for sentence imme- 
diately following the playlist_namejength. The Resu- 

30 meinfo() is a region into which, when reproduction of the 
PlayList is ended intermediately, information represent- 
ative of the position at which the reproduction is inter- 
rupted is placed. The synch ronous_start_pts repre- 
sents, where an effective aux_audio_path is present, a 

35 start time of the aux_audio_path. The 
synch ronous_start_pts is used to realize synchronous 
reproduction between a main path and an aux audio 
path. The num_of_Dlayitems_for__main represents the 
number of Playitems which form a main path. The 

40 num_of_playitems_for__aux_audio represents the 
number of Playitems which form the aux_audio path. 
The PlaylistlnfoDescriptor() is a region for placing infor- 
mation, explanation of contents and so forth relating to 
the PlayList, and information relating to the PlayList is 

45 described by a for sentence. 

[0052] FIG. 10 shows a structure of the block Playitem 
(). The file_name_length represents a data length of a 
file name of a Clip information file (af He whose extension 
is dpi) which is referred to by the Playitem, and a char- 

50 acter string of the file name is placed in a for sentence 
immediately following the file_name_length. The 
prog ram_n umber represents a program_number which 
specifies a program referred to by the Playitem (the pro- 
gram denotes a collection of elementary streams of vid- 

55 eo, audio and other data as defined by the MPEG sys- 
tems). 

[0053] The sequence_id represents a section of a 
range of time within which the PCR is continuous. Since 
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a consistent continuous time base can be defined in the 
section, a start point and an end point of the Playitem 
can be defined uniquely. In other words, the start point 
and the end point of each Playitem must be present in 
the same sequence. The playitem_namejength repre- 
sents the data length of the name of the playitem, and 
a character string of the name is placed in a for sentence 
immediately following the playitem_name_length. The 
condition J N represents a condition of AV stream data 
which corresponds to a start portion of the Playitem. The 
condition_OUT represents a condition of AV stream da- 
ta which corresponds to an end portion of the Playitem. 
Details of the conditions are hereinafter described with 
reference to FIG. 19. 

[0054] The playitem_start_time_stamp represents a 
pts (presentation time stamp) at the start point of the 
Playitem. However, when the conditionJN is 0x03, 
since the AV stream file is read in and decoded up to 
the last end thereof, the playitem_start_time_stamp is 
unnecessary. The playitem_end_time_stamp repre- 
sents a pts at the end portion of the Playitem. However, 
when the condition_OUT is 0x03, since the AV stream 
file is read in and decoded beginning with the top there- 
of, the playitem_end__time_stamp is unnecessary. 
[0055] Now, characteristics of the Playlist having the 
data structure described above are described succes- 
sively. 

1) The Playlist is a collection of only those portions 
to be reproduced of a "material" called Clip each 
with an IN point (start point) and an OUT point (end 
point). 

2) The Playlist is a unit which is recognized as one 
unity by a user similarly to the Clip. 

3) The Playlist is also a structure for realizing non- 
destructive assemble editing. The Clip and the 
Playlist have a Master-Slave relationship, and even 
if a Playlist is produced, divided, merged or erased, 
the Clip is not changed thereby. 

4) A portion of the Clip which is designated is called 
Playitem. A Playlist is composed of an array of Play- 
items. 

5) The Playitem is principally composed of a file id 
or a file name for specifying an AV stream file, a 
prog ram_n umber prescribed for an MPEG2 trans- 
port stream and an IN point and an OUT point on a 
program corresponding to the program_number. In 
the Clip, for each program, a local time base is de- 
fined for each section within which the PCR is con- 
tinuous, and the IN point and the OUT point can 
each be represented using a pts. 

6) A reproduction designation range of Playitems 
which form a Playlist is closed within a PCR contin- 
uous section of the Clip as seen in FIG. 11 . 

7) One Playitem cannot be shared by two or more 
Playlists. 

8) Only one Playitem is produced from a Clip which 
forms a bridge sequence. The Clip which forms a 



bridge sequence is not shared between a plurality 
of Playitems. 

9) The Playlist allows post-recording. An object of 
such post-recording is maintained in a nondestruc- 

5 tive state. As a path for post-recording, one AUX 
Audio path is provided in the Playlist as seen in FIG. 
1 2. An array of video and audio Playitems which are 
outputted as a main output is called main path. 

10) Reproduction times of a plurality of Playitems 
10 do not overlap with each other in time on a single 

path. Where two or more Playitems are arranged 
on one main path, the Playitems are arranged 
closely to each other and no gap must be present 
between the reproduction times. 
is 11) The reproduction type of the Playlist is the same 
as the reproduction time of the main path. 

12) The number of Playitems which are present on 
the AUX Audio path is 0 or 1 . 

13) The range between the reproduction start time 
20 and the reproduction end time of the AUX Audio 

path must not exceed the range between the repro- 
duction start time and the reproduction end time of 
the main path. 

25 [0056] Subsequently, operations upon nondestruc- 
tive editing of a Playlist are described. . 

1) Production of a Playlist 

30 [0057] When an AV stream is recorded newly, a Clip 
composed of an AV stream file and AV stream file infor- 
mation, and a Playitem which refers to the Clip is pro- 
duced and then a Playlist is produced. 

35 2) Erasure 

[0058] When a reproduction order destination which 
has become unnecessary is to be erased, it is erased 
over all of the Playlists or in a unit of a Playitem. 

40 

3) Division 

[0059] As seen in FIG. 13, a Playitem which forms one 
Playlist is divided into Playitems, and a Playlist is formed 
45 for each of the Playitems obtained by the division. 

4) Merge (non-seamless or seamless connection) 

[0060] Two Playlists are connected to form a single 
50 Playlist. Merge processing is different, at the connection 
point, depending upon whether the Playlists are merged 
such that they may be reproduced in such a seamless 
manner that an image and sound are not interrupted or 
the Playlists are merged such that they may be repro- 
55 duced in a non-seamless manner that occurrence of in- 
terruption is allowed. When the two Playlists are merged 
so as to allow no n -seam I ess reproduction, a new AV 
stream need not be produced, but the Playitems of the 
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two Playlists are arranged in a row in a reproduction or- 
der to form one Playlist as seen in FIG. 14A. It is to be 
noted that, where the Playlists which compose the two 
Playlists to be merged refer to the same Clip and the 
portions to be referred to are continuous to each other 
as seen in FIG. 14B, also the Playitems are merged. 
FIG. 15 indicates an example wherein a bridge se- 
quence (details are hereinafter described) for connect- 
ing the two Playlists so as to allow seamless reproduc- 
tion is produced. 

5) Movement 

[0061] As seen in FIG. 1 6, an array of Playlists in the 
Playlist block which defines a reproduction order of the 
Playlists is changed. Each Playlist is not changed. 

6) Clip conversion 

[0062] It is assumed that, for example, a material im- 
aged by means of a video camera is converted into a 
Clip and a Playlist for reproduction of part of the Clip is 
produced. After a Playlists is completed, when it is de- 
sired to newly make another Clip with which reproduc- 
tion is performed in the reproduction order of the same 
and the entity of the stream is involved, portions desig- 
nated by the Playlist are copied to produce a new Clip 
as seen in FIG. 1 7 (the original Clip is converted into the 
new Clip). 

7) Minimization of a Clip 

[0063] As seen in FIG. 1 8, any portion of a Clip which 
is not designated for reproduction by any Playlist (or 
Play item which forms a Playlist) is erased. 

8) Erasure of a Clip 

[0064] A Clip which is not designated for reproduction 
by any Playlist (or Playitem which forms a Playlist) is 
erased. 

[0065] Minimization of a Clip and erasure of a Clip are 
operations for erasing unnecessary data to increase the 
free capacity of the disk. 

[0066] Subsequently, seamless reproduction be- 
tween Playitems which form a Playlist is described. In 
order to realize seamless reproduction between Play- 
items, the state of a connection point of each Playitem 
must be classified. Here, the state of a connection point 
of a Playitem is classified into one of four types including 
an A type, a C type, a D type and an E type as seen in 
FIG. 19. 

[0067] The A type denotes a state wherein the IN point 
(start point) and the OUT point (end point) of a Playitem 
designate an arbitrary picture of an AV stream. Where 
images are coded in accordance with the MPEG video 
system, a designated picture is not limited to an f picture 
but may be a P picture or a B picture. Therefore, for ex- 



ample, where the designated picture is a P picture or a 
B picture, in order to display the picture designated with 
the IN point, data of a picture preceding to the IN point 
are required. Since the information that a Playitem has 
5 is a pts of the IN point, the position of a preceding picture 
from which data are to be read is determined arbitrarily 
by the reproduction side. Consequently, if the reading 
start position is preceding by an excessively great dis- 
tance, then unnecessary data for reproduction of the P 
picture orthe B picture may be read in. Similarly, in order 
to display a picture at the OUT point, data of a picture 
necessary for decoding must be read in although they 
are not displayed. In such an instance, after decoding 
of the picture at the OUT point is completed, it is neces- 
sary to flash (or erase the data) of the frame buffer of 
the decoder before data of the next Playitem are decod- 
ed. Further, since unnecessary data later than the OUT 
point may remain stored in the buffer of the decoder, 
also the decoder buffer must be flashed. 
[0068] After all, when a connection face of the A type 
is to be reproduced, it is necessary to interrupt ordinary 
reproduction processing such as continuous decoding 
and continuous displaying and perform such processing 
of reading in data which are not displayed as described 
above. Therefore, there is the possibility that the bound- 
ary between playitems may become non-seamless. 
[0069] The C type denotes a state wherein the con- 
nection point is a clean break. The clean break is a con- 
dition wherein such tail processing as to remove data 
unnecessary for decoding has been performed. This 
connection point is produced by demultiplexing and de- 
coding data around the connection point and then re- 
encoding and re-multiplexing the demultiplexed decod- 
ed data. Accordingly, different from the A type, the C 
type does not require data of a picture preceding to a 
picture at the connection point or data of a picture fol- 
lowing the picture at the connection point. In order to 
make the condition of a connection point the C type, for 
example, it is only required to re-encode a picture cor- 
responding to the IN point so that it may be the top of a 
GOP (Group Of Pictures) and re-encode a picture cor- 
responding to the OUT point so that it may be the last 
picture of the GOP. It is to be noted, however, that the 
PCR is discontinuous at the connection point of the C 
type. 

[0070] The D type is a type of a connection point for 
allowing jumping from or to an intermediate portion of 
an AV stream file and denotes a condition wherein it is 
continuous to preceding and following Playitems in the 
accuracy of a byte. Accordingly, if data are read out from 
the AV stream file in accordance with the arranged order 
of the Playitems, then a continuous bit stream is ob- 
tained although an exchange of a file is involved, and 
continuous decoding is possible. A connection point of 
the D type appears when the reproduction point goes 
out from an intermediate portion of a file and enters a 
bridge sequence or when the reproduction point goes 
out of a bridge sequence and enters an intermediate 



15 



20 



25 



30 



35 



40 



45 



50 



8 



EP 1 103 974 A2 



16 



15 

portion of a file. 
[0071] The E type denotes a state wherein the Play- 
item is the top or the last of an AV stream file and, at the 
position, the bit stream is continuous to the preceding 
or following Play item in the accuracy of a byte. The E 
type and the D type are different from each other in 
whether or not a picture designated by a Play item is 
placed just at the top or last position of a file. The E type 
appears when a bridge sequence or a continuous 
stream is divided into two files. 
[0072] FIG. 20A illustrates an example wherein two 
AV streams are partly designated each with an IN point 
and an OUT point to produce Playitems, and the Play- 
items are arranged to form a Playlist. In this instance, 
since no special processing is performed for the AV 
streams but the Playitems are merely arranged, both of 
the connection points of the two Playitems become 
those of the A type. Accordingly, there is the possibility 
that discontinuity such as interruption of an image may 
occur between the two Playitems, and seamless repro- 
duction is not assured. 

[0073] FIG. 20B illustrates an example wherein two 
connection points are of the C type. In this instance, 
seamless reproduction is assured even across the two 
Playitems. 

[0074] FIG. 20C illustrates an example wherein an 
originally one AV stream file is divided into two files and 
the two files are connected by Playitems. Playitems 
which connect divided AV stream files in this manner 
have connection points of th e E type. Accordingly, if data 
are read in continuously at the boundary between the 
AV stream files, then a continuous bit stream is obtained 
without execution of special processing. Consequently, 
seamless reproduction is assured. 
[0075] FIG. 20 D illustrates an example wherein a 
bridge sequence is produced to allow seamless repro- 
duction of two Playitems. The bridge sequence is a 
method for realizing seamless reproduction without 
modifying an original AV stream file. The example of 
FIG. 20D is different from the example of FIG. 20B in 
that an original AV stream file is not modified. Here, the* 
point at which the reproduction point goes out from in- 
termediately of the AV stream file in order to enter the 
bridge sequence and the point at which the reproduction 
point goes out of the bridge sequence and enters an in- 
termediate point of the AV stream file are of the D type. 
[0076] Subsequently, a bridge sequence which is a 
structure for allowing seamless reproduction between 
two Playitems having connection points of the D type. 
The bridge sequence is a short AV stream produced by 
copying or partly re-encoding an AV stream around a 
connection point in a free area on a disk. Upon repro- 
duction, the short AV stream as the bridge sequence is 
reproduced to realize seamless reproduction. The 
bridge sequence may be formed from two AV stream 
files across a clean break as seen in FIG. 21 A or from 
a single AV stream file as seen from FIG. 21 B. 
[0077] The clean break is used in a case wherein two 



Clips are reproduced seamlessly or in another case 
wherein two Playitems are reproduced seamlessly. 
When two Clips are reproduced seamlessly, if re-encod- 
ing and re-multiplexing are performed, then the ends of 

5 the AV stream files seamlessly connected to each other 
make such a clean break as seen in FIG. 22A. Usually, 
data in elementary streams to be displayed at the same 
timing are positioned in a spaced relationship from each 
other in a file due to a multiplexing phase difference in 

10 the MPEG2 systems. The clean break is a condition 
wherein an elementary stream to be displayed before a 
certain timing and another elementary stream to be dis- 
played after the certain timing are separated in separate 
files from each other taking the multiplexing phase dif- 

is ference into consideration. Naturally, also audio data to 
be reproduced at the same timing as the timing at which 
video data present in the preceding side file are dis- 
played are included in the preceding side file, and sim- 
ilarly, also audio data to be reproduced at the same tim- 

20 jng as the timing at which video data present in the fol- 
lowing side file are present in the following side file. 
[0078] The bridge sequence is formed, where, for ex- 
ample, two Playitems are to be seamlessly reproduced, 
as an AV stream file independent of the original AV 

25 stream file as seen in FIG. 22B. The bridge sequence 
is produced as a new file by copying a bit stream around 
a connection point (the original AV stream file), and only 
the portion is re-made by decoding and re-encoding. 
[0079] Now, requirements 1-1 to 4-1 upon production 

30 of a bridge sequence are described. From the necessity 
for the assurance of continuous supply and the continu- 
ity of read out data, points a, d, e and h (FIGS. 21 A and 
21 B) on the bridge sequence must be byte positions 
which satisfy the following requirements. 

35 [0080] The bridge sequence production requirements 
where attention is paid to a relationship between a frag- 
ment and a segment are described. Here, a segment 
denotes a portion of a fragment which is occupied by 
data. 

40 [0081] 1-1) As seen in FIG. 23, bridge sequences S2 
and S3 and segments SI and S4 complementary to the 
bridge sequences must have a size greater than 0.5 
fragment. 

[0082] The bridge sequence production requirement 
45 2-1 is described. 

[0083] 2-1 ) As seen in FIG. 24, the position of the point 
a is determined based on an OUT point designated by 
a user. 

[0084] More particularly, the top of a source packet in 
50 which CP I is present in a rear half portion of a fragment 
(half of fragment) is determined as a candidate to the 
point a. If the point a cannot be found out in the object 
fragment, then the object fragment is changed to the 
preceding fragment, and a point which satisfies the re- 
55 quirement is searched for in the fragment. A source 
packet is a transport packet with time information of 4 
bytes added thereto. The object fragment is changed 
retroactively one by one fragment until the point a is 



9 



17 EP 1 103 974 A2 18 



found out. The portion from the point a to the OUT point 
designated by the user is either copied as it is or reen- 
coded and placed into the bridge sequence, whether a 
point indicated by the CPI is included in the latter half of 
a fragment and the number of CPIs included rely upon 
the bit rate. More detailed processing is hereinafter de- 
scribed with reference to a flowchart of FIG. 29. 
[0085] Bridge sequence production requirements 
where attention is paid to a relationship between an 
aligned unit and CPI are described with reference to 
FIGS. 25A and 25B. It is to be noted that the aligned unit 
is a unit used when an AV stream is placed into a file, 
and is a structure for handling a predetermined number 
of successive sectors on a file system as one unit. The 
top of an aligned unit is aligned with a source packet, 
and consequently, an aligned unit begins with the top of 
a source packet without failure. An AV stream file is 
formed from an integral multiple of an aligned unit. 
[0086] The CPI denotes a position which can be ran- 
domly accessed in an AV stream (a position at which 
decoding can be started), and makes a database of a 
pts (presentation time stamp) of a picture in the AV 
stream and an intra-file byte position of the picture. If 
the CPI database is referred to, then time stamps which 
define the IN point and the OUT point of a Playitem can 
be converted into a byte position of the Playitem in the 
AV stream file. On the contrary, if there is no CPI data- 
base, then since conversion from a display time into an 
intra-file byte position is difficult, a connection point to a 
bridge sequence must be adjusted to the position des- 
ignated by the CPI. 

[0087] Bridge sequence production requirements 3-1 
to 3-7 where attention is paid to an aligned unit and CPI 
having such characteristics as described above are list- 
ed below. 

[0088] 3-1) The point b (FIG. 25A) of the bridge se- 
quence is aligned with the aligned unit because it is the 
top of the file. 

[0089] 3-2) The point b is also the top of a source 
packet. 

[0090] 3-3) Where the range from the point b to the 
point d is defined as a file, the length thereof must be 
equal to an integral number of times that of the aligned 
unit. 

[0091] 3-4) While the point a is designated by the pts, 
in order to discriminate the byte position, the CPI is re- 
ferred to. Accordingly, the point a must be a point des- 
ignated by the CPI (precisely, upon reproduction, the re- 
production point goes out at a byte immediately preced- 
ing to a source packet designated by the point a). 
[0092] 3-5) The range from the point a to the point b 
is continuous in the accuracy of a byte (D type-E type 
connection). Accordingly, also the point b is a point des- 
ignated by the CPI. 

[0093] 3-6) Since the point d is designated by the pts, 
the point e must be a point designated by the CPI. 
[0094] 3-7) Since the points b and e are points desig- 
nated by the CPI, each of them must be the top of a 



source packet. The points a and e may not be aligned 
with an aligned unit. 

[0095] Subsequently, requirements of a Playitem 
which designates a bridge sequence is described with 

5 reference to FIGS. 26A and 26B. As seen in FIGS. 21 A 
and 21 B, a bridge sequence can be obtained by two dif- 
ferent methods including a method wherein it is formed 
as two AV streams divided with a clean break and an- 
other method wherein it is formed as a single AV stream. 

10 Whichever one of the two methods is used, the number 
of Playitems which designate the bridge sequence is 
two. This is because, even if the bridge sequence is 
formed as a single AV stream, it includes a PCR discon- 
tinuity point, at which it is divided into two Playitems. 

15 This is intended to facilitate time management with the 
playitems and, since there is the possibility that a PCR 
discontinuity point may appear only at a boundary of a 
Playitem, to eliminate the necessity to take a disconti- 
nuity point into consideration during reproduction of a 

20 Playitem by providing the restriction that a PCR discon- 
tinuity point does not appear within a Playitem. 
[0096] According to the syntax of the block Playitem 
() shown in FIG. 10, a set of an IN point and an OUT 
point that a Playitem has must be within a section having 

25 a continuous PCR designated by the same 
sequence_id. From the foregoing, the bridge sequence 
production requirement 4-1 around a PCR discontinuity 
point is such as follows. 

[0097] 4-1 ) Since a playitem can be designated within 
30 a range having a continuous PCR, the playitem is divid- 
ed at a PCR discontinuity point C. 
[0098] A Playlist which can be seamlessly reproduced 
can be produced in accordance with such bridge se- 
quence production requirements 1-1 to 4-1 as described 
35 above. 

[0099] Subsequently, a setting process for conditions 
of connection points (conditionJN and condition_OUT) 
of a Playitem upon production of a Playlist is described 
with reference to a flowchart of FIG. 27. 

40 [0100] In step S1 , an input of a range in a Clip to be 
reproduced is accepted. In particular, a user will input 
an IN point and an OUT point to designate a range to 
be reproduced. In step S2, it is discriminated whether 
or not the inputting of an IN point and an OUT point is 

45 completed, and such inputting of an IN point and an OUT 
point by the user is accepted until the inputting of an IN 
point and an OUT point comes to an end. If it is discrim- 
inated that the inputting of an IN point and an OUT point 
comes to an end, then the processing advances to step 

50 S3. 

[0101] In step S3, attention is paid to one of connec- 
tion points in accordance with the order of reproduction. 
In step S4, it is discriminated whether or not processing 
for allowing seamless reproduction to be performed at 
55 the connection point should be performed. If it is discrim- 
inated that processing for allowing seamless reproduc- 
tion to be performed should be performed, then the 
processing advances to step S5. 
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[0102] In step S5, it is discriminated whether or not 
the following processing should be executed without de- 
stroying the Clip to be referred to. If it is discriminated 
that the following processing should be executed with- 
out destroying the Clip to be referred to, then the 
processing advance to step S6, in which a bridge se- 
quence is produced. In step S7, two Playitems which 
refer to the two Clips newly produced are inserted be- 
tween the connection points. The two Playitems have a 
D type-E type connection wherein the Condition_out of 
the front side Playitem is of the D type and the 
Condition JN of the rear side Playitem is of the E type, 
or a C type-C type connection wherein the 
Condition_out of the front side Playitem is of the C type 
and the Condition JN of the rear side Playitem is of the 
C type, or else an E type-D type connection wherein the 
Condition_out of the front side Playitem is of the E type 
and the ConditionJN of the rear side Playitem is of the 
D type. 

[0103] In step S8, it is discriminated whether or not 
the Playlists still have a connection point which has not 
been processed as yet. If it is discriminated that a con- 
nection point which has not been processed as yet re- 
mains, the processing returns to step S3 so that the 
processing in step S3 et seq. is repeated. 
[0104] It is to be noted that, if it is discriminated in step 
S5 that the succeeding processing should be executed 
while the Clip to be referred to is destroyed, then the 
processing advances to step S9, in which a clean break 
is produced. In step S1 0, part of the Clip is changed so 
as to have a C type-C type connection wherein the 
Condition_out of the front side Playitem is of the C type 
and the ConditionJN of the rear side Playitem is of the 
Ctype. 

[0105] On the other hand, if it is discriminated in step 
S4 that processing for allowing seamless reproduction 
to be performed should not be performed, then the 
processing advances to step S11 . In step S11 , it is de- 
termined that processing for realizing seamless repro- 
duction is not performed. Then in step S12, the Play- 
items are changed so as to have an A type-A type con- 
nection wherein the Condition_out of the front side Play- 
item is of the A type and the ConditionJN of the rear 
side Playitem is of the A type. 

[0106] Subsequently, a reproduction process based 
on a Play list is described with reference to a flowchart 
of FIG. 28. In step S21 , one of existing Playlists is se- 
lected. In step S22, the top one of Playitems which form 
the Playlist selected in step S21 is selected, and repro- 
duction of the Clip based on the selected Playitem is 
started. In step S23, it is discriminated whether or not 
the reproduction of the Clip based on the selected Play- 
item comes to an end, and it is waited that it is discrim- 
inated that the reproduction of the Clip based on the 
Playitem comes to an end. If it is discriminated that the 
reproduction of the Clip based on the Playitem comes 
to an end, then the processing advances to step S24. 
[0107] In step S24, it is discriminated whether or not 



there is a next Playitem which follows the current Play- 
item. If it is discriminated that there is no next Playitem, 
then the present Playlist reproduction process is ended. 
However, if it is discriminated that there is a next Play- 
s item, then the processing advances to step S25. 

[0108] In step S25, it is discriminated whether or not 
the connection point to the next Playitem has an A type- 
A type connection. If it is discriminated that the connec- 
tion point to the next Playitem has an A type-A type con- 
10 nection, then since a gap appears at the connection 
point of the Playitem, the processing advances to step 
S26, in which the decoder is reset and a release process 
is executed. In step S27, reproduction of the Clip is start- 
ed based on the next Playitem. Thereafter, the process- 
es ing returns to step S23 so that the processing in step 
S23 et seq. is repeated. 

[01 09] It is to be noted that, if it is discriminated in step 
S25 that the connection point to the next Playitem does 
not have an A type-A type connection, then the process - 

20 ing advances to step S28. In step S28, it is discriminated 
whether or not the connection point to the next Playitem 
has a C type-C type connection. If it is discriminated that 
the connection point to the next Playitem has a C type- 
C type connection, then it is discriminated in step S29 

25 that the connection point is reproduced with a clean 
break. In step S30, the data of the Clip referred to by the 
front side Playitem are read in up to the last data thereof, 
and then reading in of the Clip beginning with the top 
data which is referred to by the next Playitem is started. 

30 Changing over of a PCR is performed seamlessly by the 
decoder. Then, the sequence advances to step S27. 
[0110] If it is discriminated in step S28 that the con- 
nection point to the next Playitem does not have a C 
type-C type connection, then the processing advances 

35 to step S31 . In step S31 , it is discriminated whether or 
not the connection point to the next Playitem has a D 
type-E type connection. If it is discriminated that the con- 
nection point to the next Playitem has a D type-E type 
connection, then the processing advances to step S32, 

^o in which it is determined that the connection point is a 
connection point with which the bridge sequence is en- 
tered. In step S33, the Playitem_endjime_stamp and 
the CP I designated by the front side Playitem are re- 
ferred to and the reading in is stopped intermediately of 

45 the Clip, and reading in of the Clip referred to by the next 
Playitem is started beginning with the top data of the 
Clip. The data read in are decoded in the order in which 
they are read in. Then, the processing advances to step 
S27. 

50 [0111] If it is discriminated in step S31 that the con- 
nection point to the next Playitem does not have a D 
type-E type connection, then the processing advances 
to step S34. In step S34, it is discriminated whether or 
not the connection point to the next Playitem has an E 

55 type-D type con nection. If it is discriminated that the con- 
nection point to the next Playitem has an E type-D type 
connection, then the processing advances to step S35, 
in which it is discriminated that the connection point is 
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a connection point at which the reproduction point goes 
out of the bridge sequence. In step S36, the data of the 
Clip referred to by the front side Playitem are read in up 
to the last data thereof, and then the 
Playitem_start_time_stamp and the CPI are referred to s 
and reading in of the Clip is started beginning with the 
intermediate portion of the same. The data read in are 
decoded in the order in which they are read in. Then, 
the processing advances to step S27. 
[0112] if it is discriminated in step S34 that the con- 10 
nection point to the next Playitem does not have an E 
type-D type connection, then the processing advances 
to step S37. In step S37, it is discriminated that the con- 
nection point has an E type-E type connection. The data 
are read in without taking a delimitation of a file into con- '5 
sideration, and if the data are decoded in the order in 
which they are read in, then they are reproduced seam- 
lessly. Then, the processing advances to step S27. 
[0113] Now, a detailed process of the bridge se- 
quence production requirement 2-1 "to determine the 20 
position of the point a based on the OUT point designat- 
ed by a user" is described with reference to a flowchart 
of FIG. 29. 

[0114] In step S51 , an OUT point from a Clip is des- 
ignated. In step S52, it is discriminated whether or not 25 
the timing of the OUT point is on the CPI. If the repro- 
duction timing of the OUT point is not on the CPI, then 
the processing advances to step S53. In step S53, if a 
point or points which are each indicated by the CPI cor- 
responding to a timing preceding to the timing of the 30 
OUT point are present, then the nearest one of the 
points is determined as a new OUT point. It is to be noted 
that, if it is discriminated in step S52 that the reproduc- 
tion timing of the OUT point is on the CPI, then the 
processing in step S53 is skipped. 35 
[0115] In step S54, it is discriminated whether or not 
the magnitude (byte number) from the top of the frag- 
ment to the OUT point is greater than one half the frag- 
ment. If it is discriminated that the magnitude from the 
top of the fragment to the OUT point is greater than one *o 
half the fragment, then the processing advances to step 
S55. 

[01 1 6] In step S55, the timing designated with the OUT 
point is determined as the Playitem_end_time_stamp of 
the Playitem. In step S56, the condition_out of the Play- *s 
item is determined as the D type. In step S57, data fol- 
lowing the Playitem_end_time_stamp are copied and a 
Clip of the front half of a bridge sequence is produced 
newly. The Clip and the newly produced Clip are con- 
nected to each other by a D type-E type connection. 50 
[0117] If it is discriminated in step S54 that the mag- 
nitude from the top of the fragment to the OUT point is 
not greater than one half the fragment, then the process- 
ing advances to step S58. In step S58, it is discriminated 
whether or not the preceding segment is present. If it is 55 
discriminated that the preceding segment is present, 
then the processing advances to step S59. In step S59, 
the search range is changed to the preceding segment. 
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In step S60, a point which is present in the preceding 
segment and is the latest point in reproduction timing 
represented by the CPI is determined as the OUT point. 
Then, the processing returns to step S54. 
[01 18] It is to be noted that, if it is discriminated in step 
S58 that the preceding segment is not present, then the 
processing advances to step S61 , in which it is discrim- 
inated that it is impossible to determine the 
condition_out of the Playitem as the D type, and the 
condition_out is determined as the A type. 
[0119] As described above, according to the present 
invention, by providing a file Playlist, which is a file in- 
dependent of an AV stream file and has only a link struc- 
ture indicating an AV stream, with information indicative 
of a state of aconnection point between Playitems, aug- 
mentation of the reproduction quantity is allowed. 
[0120] It is to be noted that, while, in the present em- 
bodiment, the medium onto which an AV stream file and 
so forth are to be recorded is an. optical disk, any other 
medium may be used only if it allows random accessing. 
[0121] By the way, while the series of processes de- 
scribed above can be executed by hardware, it may oth- 
erwise be executed by software. Where the series of 
processes is executed by software, a program which 
constructs the software is installed from a recording me- 
dium into a computer incorporated in hardware for ex- 
clusive use or, for example, a personal computer for uni- 
versal use which can execute various functions by in- 
stalling various programs. 

[0122] The recording medium is distributed in order to 
provide the program to a user separately from a com- 
puter. The recording medium is not only formed as a 
package medium such as a magnetic disk (including a 
floppy disk), an optical disk (including a CD-ROM (Com- 
pact Disc-Read Only Memory) and a DVD (Digital Ver- 
satile Disc)), a magneto-optical disk (including an MD 
(Mini Disc)) or a semiconductor memory or but also 
formed as a ROM (which corresponds to the ROM 22 
of FIG. 1 ), a hard disk or the like in or on which the pro- 
gram is recorded and which is provided in a state where- 
in the program is incorporated in a computer in advance 
to a user. 

[01 23] It is to be noted that, in the present application, 
the steps which describe the program recorded on a re- 
cording medium may be but need not necessarily be 
processed in a time series in the order as described, 
and include processes which are executed parallelly or 
individually. 

[0124] While a preferred embodiment of the present 
invention has been described using specific terms, such 
description is for illustrative purposes only, and it is to 
be understood that changes and variations may be 
made without departing from the spirit or scope of the 
following claims. 

[0125] In so far as the embodiments of the invention 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 
appreciated that a computer program providing such 
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software control and a storage medium by which such 
a computer program is stored are envisaged as aspects 
of the present invention. 



Claims 

1 . A recording/reproduction apparatus for recording or 
reproducing AV data onto or from a recording me- 
dium, comprising: 

AV data file recording means for recording an 
AV data file obtained by converting the AV data 
into a file onto the recording medium; 
production means for producing reproduction 
range information representative of a range of 
reproduction of the AV data file; 
classification means for classifying a state of at 
least one end of the range of reproduction; 
addition means for adding information repre- 
sentative of a result of the classification of said 
classification means to the reproduction range 
information; 

preparation means for arranging at least more 
than one piece of the reproduction range infor- 
mation in order for reproduction to prepare a 
reproduction list; and 

reproduction list recording means for recording 
the reproduction list onto the recording medi- 
um. 

2. A recording/reproduction apparatus according to 
claim 1 , wherein said classification means classifies 
the state of at least one end of the reproduction 
range into one of four types. 

3. A recording/reproduction apparatus according to 
claim 1, further comprising formation means for 
forming a bridge sequence in response to a result 
of the classification of said classification means. 

4. A recording/reproduction method for a recording/re- 
production apparatus for recording or reproducing 
AV data onto or from a recording medium, compris- 
ing: 

an AV data file recording step of recording an 
AV data file obtained by converting the AV data 
into a file onto the recording medium; 
a production step of producing reproduction 
range information representative of a range of 
reproduction of the AV data file; 
a classification step of classifying a state of at 
least one end of the range of reproduction; 
an addition step of adding information repre- 
sentative of a result of the classification by the 
processing in the classification step to the re- 
production range information; 



a preparation step of arranging at least more 
than one piece of the reproduction range infor- 
mation in order for reproduction to prepare a 
reproduction list; and 
5 a reproduction list recording step of recording 

the reproduction list onto the recording medi- 
um. 

5. A recording medium on which a computer- read able 
10 program for recording or reproducing AV data onto 
or from an information recording medium is record- 
ed, the program comprising: 

an AV data file recording step of recording an 
15 AV data file obtained by converting the AV data 

into a file onto the information recording medi- 
um; 

a production step of producing reproduction 
range information representative of a range of 
20 reproduction of the AV data file; 

a classification step of classifying a state of at 
least one end of the range of reproduction; 
an addition step of adding information repre- 
sentative of a result of the classification by the 
25 processing in the classification step to the re- 

production range information; 
a preparation step of arranging at least more 
than one piece of the reproduction range infor- 
mation in order for reproduction to prepare a 
30 reproduction list; and 

a reproduction list recording step of recording 
the reproduction list onto the information re- 
cording medium. 

35 6. A recording/reproduction apparatus for recording or 
reproducing AV data onto or from a recording me- 
dium, comprising; 

readout means for reading out a reproduction 
40 list recorded on the recording medium; 

extraction means for extracting information rep- 
resentative of a state of at least one end of a 
range of reproduction from among at least more 
than one piece of reproduction range informa- 
45 tion which forms the reproduction list; and 

reproduction means for reproducing the AV da- 
ta recorded on the recording medium based on 
the information representative of the state of 
the at least one end of the range of reproduction 
50 extracted by said extraction means. 

7. A recording/reproduction method for a recording/re- 
production apparatus for recording or reproducing 
AV data onto or from a recording medium, compris- 
55 ing: 

a readout step of reading out a reproduction list 
recorded on the recording medium; 
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an extraction step of extracting information rep- 
resentative of a state of at least one end of a 
range of reproduction from among at least more 
than one piece of reproduction range informa- 
tion which forms the reproduction list; and 5 
a reproduction step of reproducing the AV data 
recorded on the recording medium based on 
the information representative of the state of 
the at least one end of the range of reproduction 
extracted by the processing in said extraction 10 
step. 



A recording medium on which a computer-readable 
program for recording or reproducing AV data onto 
or from an information recording medium is record- '5 
ed, the program comprising: 



a readout step of reading out a reproduction list 
recorded on the information recording medium; 
an extraction step of extracting information rep- 20 
resentative of a state of at least one end of a 
range of reproduction from among at least more 
than one piece of reproduction range informa- 
tion which forms the reproduction list; and 
a reproduction step of reproducing the AV data 25 
recorded on the information recording medium 
based on the information representative of the 
state of the at least one end of the range of re- 
production extracted by the processing in said 
extraction step. 30 
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